Exact Moment Scaling from Multiplicative Noise 
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For a general class of diffusion processes with multiplicative noise, describing a variety of physical 
as well as financial phenomena, mostly typical of complex systems, we obtain the analytical solution 
for the moments at all times. We allow for a non trivial time dependence of the microscopic dynamics 
and we analytically characterize the process evolution, possibly towards a stationary state, and the 
direct relationship existing between the drift and diffusion coefficients and the time scaling of the 
moments. 
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Many different physical phenomena exhibit a com- 
plex behaviour characterized by long range correlations, 
long time memory, scale invariance and the emergence 
of non Gaussian distributions associated to their statisti- 
cal description. Deviations from the Maxwell-Boltzmann 
statistics were usually considered as a clear mark of an 
out of equilibrium system, but recently it has been recog- 
nized that Normality is not the most general paradigm 
describing the equilibrium state. Indeed, in terms of a 
microscopic description provided by the Langevin equa- 
tion, power law tails stem naturally assuming the damp- 
ing coefficient to have a stochastic nature From a 
macroscopic point of view, the superposition of an ad- 
ditive Gaussian noise with a multiplicative one leads 
to a Fokker-Planck (FP) equation with linear drift and 
quadratic diffusion coefficients. Processes leading to a 
macroscopic equation with the same structure emerge in 
the description of severalphysical systems ranging from 
turbulent velocity flows |2|, power law spectra in e + e~, 
pp and heavy ions collisions |3| , anomalous diffusion phe- 
nomena [i| , to the study of non stationary scaling Markov 
processes with Hurst exponent H =/= 1/2 Moreover 
the same dynamics has been shown to describe heartbeat 
interval fluctuations, foreign exchange markets Q, option 
markets [7| and the statistical features of medium-term 
log-returns in a market with both fundamental and tech- 
nical traders 0] . The explicit analytical characterization 
of the probability density function (PDF) for these pro- 
cesses has been carried out only for the steady state [lj, 
while an analytical description at finite time can be given 
only in terms of a formal expansion on the set of eigen- 
functions of the FP operator [9]. In this Report, we pro- 
vide a complete description of these processes in terms 
of their moments, allowing for a more general time de- 
pendence for both the drift and diffusion coefficients. We 
obtain closed-form expressions for the moments at finite 
time; in particular, we are able to characterize analyti- 
cally how they thermalize to the stationary state and we 
highlight the existence of a direct, simple relationship be- 
tween the function regulating the time dependence and 



the scaling of the process over time. 

We start from the stochastic differential equation 
(SDE) describing the microscopic dynamics under Ito 
prescription [ll[ 



dx t = ^±V 
g(t) 



I cXf + dX t + e(t) 



g(t) 



dW t , (1) 



with initial time condition X to = Xq, to £ D C [0,tn m ) 
with iiim possibly +00; W t is the standard Brownian mo- 
tion, a, b, c, d are real constants, l/g(t) and e(t) are 
non negative smooth functions of the time over D. For 
the diffusion coefficient to be meaningful, it has to satisfy 
d 2 —4ce(t) < with c > 0. Application of the Ito Lemma 
to f(Xt) — X™ leads to the following integral relation 

rt 



X? =Xl 



xv- 



t 9(s) 

* xv- 1 



[F n X 2 + A n X s + B n (s)] ds 



■.^/cX2+dX s +e(s) dW s , (2) 



't vg{sj 

whose expectation readily provides the linear ordinary 
differential equation satisfied by the n-th order moment 
Unit) = (XI 1 ) for n > 1 



/ s d 



(t) = F nA t„(t)+A n // n _ 1 (i)+S n (t)/i„_ 2 (i) , (3) 



with boundary condition jU n (to) = (Xq"). The coefficients 
read F n = na+^n(n—l)c, A n = nb+hn(n— l)d, B n (t) = 
\n(n — l)e(t), and we assume no(t) = 1. If (Xq ) for 
k = 1, . . . , n is a finite quantity, the smoothness of 1/ g(t) 
and e(t) ensures the existence of a unique solution fj, n (t) 
over an arbitrary interval D 1 — [£*,£/] C D with to £ 
D' . In terms of the monotonously increasing function 
r(t) — J l/g(s)ds, the solution reads 



TO 



r(t) 



A n /2„_ l (Ti)dri 



-(*) 



-F„T1 



S„(Ti)/t„_2(n)dri 



(4) 
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where /2„(t) = ^ n {t{r)) and B n (r) = B n (t(r)). The pre- 
vious expression lends itself to an expansion over (Xq~ 3 ), 
for j = 0, . . . , n by iteratively substituting the moments 
entering the r.h.s. with their closed-form solutions. We 
detail how to proceed for the simpler case e(t) = e > 0. 
We define type A and type B "knots" of order k whose 
contributions are 

A k =A k f e a - T 'd T ' and B fc = B k f e bfcT 'dr' , 
Jo Jo 

with a k = -(F k -F k ^x) and b k = -(F k -F k - 2 )- We now 
consider ordered sequences of knots obtained applying 
the following rules: a) fix the order of the moment n £ 
{1, . . . , N}; b) fix j G {1, . . . , n}; c) choose the first knot 
between A„ or B n ; d) move rightward adding a new knot. 
A k can be followed by either Afc_i or by Mk-i, while 
Bfc can be followed by either Afc_2 or Bfc_2! e) if Na 
and Nb are the number of type A and type B knots, 
respectively, stop when Na + 2Nb = j- We associate 
to every ordered sequence generated going through the 
previous procedure an integral made of Na + Nb nested 
integrals. For instance, for j = 1 the only admissible 
sequence is A n . For j = 2, beside B„, we have to consider 
the sequence A„A„_i giving the contribution 

A„A„_! = A n A n ^ f e a " Tl f 1 e a »- lT Mr 2 dri . 
Jo Jo 

When j — 4 the following strings have to be taken into 
account 

A n A„_iA„_ 2 A„_3, A„A n _iB„_2, A„B n _iA„_ 3 , 
B„A„_ 2 A„_3, B„B„_ 2 - 

The special case j = is associated to a sequence with 
no knot whose contribution is equal to 1. Once n has 
been fixed, it is readily proved that every sequence is 
univocally determined retaining the label of the vertex 
while dropping the indexes. For the case j = 4 above 
strings reduce to AAAA, AAB, ABA, BAA, BB. We call 
n NaNb the set of permutations with no repetition of Na 
type A elements and Nb type B elements and t^n a n b its 
generic element; the compact notation A n (nN A N B , T (^)) 
identifies the Na + Nb -dimensional integral contributing 
to the n-th moment and corresponding to the sequence 
of knots sorted according to t^n a n b - In terms of the 
above quantities, the expression of fi n (t) can be usefully 
rewritten in the compact form 

n 

e ^r(t)J2(X^) £ 5>»fawa,r(t)) . (5) 

3=0 N A +2NB=jTlN A N B 

A careful analysis of the quantity A n (irN A N B , r(t)) shows 
that it can always be computed analytically in an algo- 
rithmic way [l5| , which makes the expansion a power- 
ful tool to exactly compute \x n up to an arbitrary order. 



Supposing that all the a k and b k involved in the expres- 
sion of fi n are non vanishing (l6j , the expansion ([5]) can 
be rewritten as 

n 

(*n(t) =J2 C ? eFn -' T(t) . ( 6 ) 

the being real possibly vanishing functions of the 
A k s, -Bfc's, Ffc's and (Xq). Above equation provides ev- 
idence of the typical scaling of the moments over time. 
The multiple time scales emerging from the multiplica- 
tive noise process can be affected by varying the func- 
tional form of g(t). For a constant g(t) = 1 we have 
t = t — to and the n-th order moment is characterized by 
the superposition of n exponentials with time constants 
{l/|F n |,...,l/|Fi|}. When g(t) = t, as in 0, we have 
terms of the form 



producing a power law time scaling of the moments. 
More generally, for g(t) = t 13 {(3 ^ 1) the time de- 
pendence turns out to be a stretched exponential with 
stretching exponent 1 — fi: 

Eq. ([5]) also allows us to gain insight into the nature of 
the stochastic process described by the model |T]), both 
at finite t and for t approaching t\\ m . As far as the PDF 
p(x, t) associated to above process is concerned, in gen- 
eral we are not allowed to draw any conclusion about 
its shape. However, an important exception is the case 
when, for t — > tn m , we have a diverging r. Indeed, in 
terms of r the PDF satisfies the FP equation 

d d Id 2 

— p{x, r) = —^ [Di (x)p(x, r)]+-^ [^(^(a:, r)] , 

" (7) 
with D\{x) — ax + b and £* 2 (x) = cx 2 + dx + e and ini- 
tial condition p(x, 0) = po(x), for which the stationary 
solution p s t{x) can be computed analytically following 
[H [ll|. This solution provides evidence of the possible 
emergence of power law tails and Eq. ([6]) precisely char- 
acterizes the way the moments converge to the stationary 
level. Indeed, the smoothness of r as a function of t im- 
plies lim t ^ t - p{x,t) = lim T ^ +00 p{x, r) = p st (x). For 

example, if g(t) = (t — £ii m ) w itb /3 > 1, the behaviour 
of p s t (x) emerging from the analysis of Eq. (J7J applies to 
p(x,t) when t approaches ii; m , while the moments scale 
according to 

e F n - 3 r(t) = e F„_ JT i J [(to-t llm ) 1 -' 3 -(t-ti, m ) 1 -' 3 ] _ 

We now discuss how our results can be employed to 
characterize the stochastic process described by the SDE 
(fTJ) for different choices of a,b,c,d, and e. Our analy- 
sis is essentially based on the sign of the factors F n -j 
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FIG. 1: (Color online) Scaling of the moments for a = b = 
9.5 x 10~ 2 and c = d — e = 8.3 x 10 -2 ; po(x) is a zero mean 
Gaussian with (Xq) = 0.01. The Monte Carlo estimates of the 
Hn 's within 68% error bars are superimposed to the analytical 
curves, exhibiting full agreement. 

appearing in ©. Indeed, F n is a convex function of 
n, depending only on a and c, whose zeros are no = 
and n% = 1 — 2a/c G K. If ni < all the moments 
diverge when t —} t^ m , while if ni > 0, all /i„'s for 
n < n\ are convergent, otherwise not. For a convergent 
|U„, the estimate of the rate of convergence is provided 
by r max = max(l/|a|, which corresponds to the 

largest relaxation time in ©. The cases n\ = 0,1,2 
have to be considered carefully, since they correspond to 
a = c/2,0 and — c/2, respectively, for which Eq. © does 
not apply (see [16]). 

Case a > and c > 0. All the moments diverge, since 
F n > Vn > 0. From [l[ the stationary solution can 
be defined only if < a < c/2 and e > and it is a 
generalized Student-i with tail exponent v = 1 + n\. For 
a > c/2 and finite t all the moments are well-defined but 
no conclusions can be drawn about the exact form of the 
PDF. An example of the latter case is shown in Figure [TJ 
with all the /i„ diverging for large t. 
Case a = and e > 0. If c = 0, then also d is and 
Eq. describes an Arithmetic Brownian motion with 
time dependent coefficients. If c > 0, then a\ = F\ = 
and Ai = for, but integration by parts reveals that no mo- 
ment converge, while the stationary solution is a power 
law with tail exponent v = 2. 

Case a < 0, c > 0, and e > 0. F n > for n > m, 
thus only the first n < n\ moments converge to a sta- 
tionary level. The special case a = —c/2 implies n\ = 2, 
63=^3=0 and B2 = er and previous conclusions are 
unchanged. Coherently the solution of the FP equation 
predicts the emergence of power law tails with v = 1+ni. 
In Figure [2] a case corresponding to n\ ~ 9.9 is shown for 
a stretched exponential time scaling, while Figure [3] cor- 
responds to the case g(t) = (t — in m ) 2 - 

Case a ^ 0, c = 0, and e > 0. Eq. (fTJ) describes an 
Ornstein-Uhlenbeck process. F n becomes a linear func- 
tion of n and the moments reach a stationary value only 
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FIG. 2: (Color online) Lowest order moments for a — —20, 
b — d — e — 0.1, c = 4.5, with g — t 9 , P = 2 and po(x) = S(x). 
In the inset the last converging moment is compared to the 
first diverging one. 

if a < 0. For a > the Gaussian PDF has time depen- 
dent unbounded mean and variance. 
Case e = and c > 0. As above the boundedness of the 
moments can be deduced from the value of n\ and for 
a < the stationary solution is an Inverted Gamma with 
shape parameter n\ > and scale parameter 2\b\/c > 0. 
If b > the Inverted Gamma is denned for x E [0, +00), 
while for b < the support is (— 00, 0]. A similar situa- 
tion occurs for d — 4ce = and d > 0, c > 0, and e > 0, 
but the support boundary point corresponds to —d/{2c). 

We can also deal with the more general case of a time 
dependent e(t), for which an analysis of the p s t(x) can not 
be performed straightforwardly. Here we outline how to 
proceed for two cases discussed in the literature @, E2 > 
emerging in the context of financial time series analysis. 
Eq. (6) in [l2| leads to a SDE belonging to the class ([1]) 
for g(t) = 1, implying r = t — to, a = —4.4 x 10" 1 , 6 = 0, 
c = 3.8 x 10~ 2 , d = 3.04 x 10~ 3 , and e(t) = e + e'e et , 
with e = 6.08 x 10~ 5 , e' = 3 x 10~ 3 , and e = -0.5. The 
type B knot now splits into the sum of two contributions 

M k =B k e fcfcT 'dr' and M' k = B' k / e^ T 'dr' , 
Jo Jo 

where B' k = \k{k - l)e'e et ° and b' k = b k + e. The last 
two sums in ([5]) have to be coherently modified as 

^ ^ ^n(^N A N B N B ,,t - t ) , 

N A +2(N B +N B ,)=j TI NaNbNbi 

while Eq. ([6]) becomes 

n 

A1 „(t) = ^ c ; i ( £ ,t )e (F "- +d ? e)(t -* o) , 
with d'j e N. 

The second case we want to discuss is the model as- 
sumed in [7] to describe the financial returns dynamics 
under the objective probability measure. It is readily 
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FIG. 3: (Color online) Lowest order moments for a — —24.3, 
b — 5, c = 12.2, d — e — 0.1, with tji m = 1 and po(ic) = 5(a;). 
The first diverging moment /15 is shown in the inset. 

proved that, denning X t = \nS t /S - [it, Eq. (2) in Q 
corresponds to Eq. (pj for g(t) = t, a = b = d = 0, 
c = (q - l)/[(2 - g)(3 - <j)], e(t) = et 2 ^ 3 " 9 ) with 
e = o- 2 [c(2-q)(3-g)]^- 1 )/( 3 -*», and (JEff) = 0,Vn > 1; 
a 2 and c are positive constants, while the Tsallis entropic 
index q belongs to (1, 5/3) to ensure the existence of mean 
and variance [l3[ . The starting time to = is a singu- 
lar point for l/g(t) and we reproduce the correct results 
in the limit to — > + . Since (Xg) = the only j con- 
tributing to the sum in @ is j = n, while b = d = 
implies that every type A knot is identically zero and so 
are all the odd moments. Thus, expansion ([5]) reduces 
to e F " T ^ A n (7To^. , r(t)) with r = hit — \nt and n = 2p, 
p > 1. Now the type B knot reads 

B fe = ifc(fc-l)ee^ lnt0 f e (bfc+ ^ )T 'dr' . 
2 Jo 

The same analysis leading to © allows us to conclude 
that 

3=0 

where the c 2p are all non- vanishing constants. The ex- 
pression in the square brackets governs the limiting be- 
haviour of fi2 P when t — > + . As a function of j, 
Fziv-j) + 2(j — p)/(3 — q) is convex and for j = p its 
value is zero, so that we only have to check the be- 
haviour for j = 0. Indeed, if F 2p + 2p/ (q — 3) > then 
lim to _> + H2 P — +oo, otherwise all the exponents of to are 
non-negative and no divergence is possible. But recalling 
the expression of c, we find q > (2p + 3)/(2p + 1), recov- 
ering the condition required in [7[ to obtain a divergent 
2p-th order moment. It is worth noticing that the previ- 
ous conclusions can be readily rephrased in terms of the 
Hurst exponent H = 1/(3 — q) as it has been done in [j| . 

In conclusion, the processes described by Eq. ^ 
emerge in the study of many complex systems. An ex- 
plicit expression for the associated PDF has not, how- 
ever, been available for finite times. In this Report we 



provided a characterization in terms of the moments, de- 
riving closed-form expressions at all orders and for all 
times. These results, revealing a simple relationship be- 
tween the time dependence of Eq. ([1} and the scaling 
behaviour of the moments provides a better understand- 
ing of how these processes evolve with time, possibly but 
not necessarily toward a stationary state and provide a 
closed-form relation between the model parameters and 
their relaxation times. We also believe that these results 
can improve the statistical analysis of historical time se- 
ries. Indeed, the analytical expressions allow to directly 
fit the time scaling of the empirical moments, providing a 
clear and simple way to fix the model parameters. More- 
over, the knowledge of the moments is crucial to exploit 
analytical approximation to the full PDF associated to 
Eq. dJ), such as the Edgeworth or more general expan- 
sions [1J] , even though recovering the PDF is a problem 
whose solution is in general not unique. 
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